Appln No. 09/694,079 
Amdt date June 8, 2004 

Reply to 0££ice action of March 8, 2004 
Amendments to the Claims; 

This listing of claims will replace all prior versions, and 
listings, of claims in the application: 

Listing of Claims; 

1-25 . (Canceled) 

26. (Previously Presented) The system of claim 28 wherein 
said timing information comprises one of timestamp information, 
timecode information, frame niombering information and global 
time of day. 

27. (Previously Presented) The system of claim 28 wherein 
said receiver synchronizes said annotation data with said video 
signal in response to said timing information. 

28. (Previously Presented) A hyperlinked reception system 
comprising: 

a receiver in communication with a broadcast channel; and 
a display device in communication with said receiver, 
wherein said receiver decodes a digital broadcast signal to 

recover a video signal and annotation data; 

wherein, in response to a viewer request, said display 

device displays said annotation data associated with said video 

signal on a frame by frame basis; and 

wherein said annotation data comprises a plurality of 

annotations having equal timing information, and said viewer 
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request comprises an indication as to which annotation of said 
plurality of annotations is to be displayed. 

29-32 . (Cancelled) 

33. (Previously Presented) The system of claim 28, 
wherein said annotation data comprises information regarding 
goods and services for sale. 

34. (Previously Presented) The system of claim 28, 

4 

wherein said annotation data comprises non- commercial 
information. 

35. (Previously Presented) The system of claim 28 
wherein said annotation data comprises mask data and at least 
one of textual data and graphics data. 

36. (Previously Presented) The system of claim 35 
wherein said mask data includes location information of an 
object in an annotated video frame. 

37. (Previously Presented) The system of claim 36 
wherein said location information includes a graphics location 
reference that represents a fixed relation to a set of pixels 
associated with said object. 
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38. (Previously Presented) The system of claim 37 
wherein said graphics location reference includes an upper left 
most pixel in said associated pixel set. 

39. (Previously Presented) The system of claim 37 
wherein said graphics location reference includes a centroid 
pixel of said associated pixel set. 

40. (Previously Presented) The system of claim 35 
wherein said mask data comprises location and shape information 
of an object in an annotated video frame. 

41. (Previously Presented) The system of claim 40 
wherein said shape information is represented by a graphical 
overlay of said object. ^ 

42. (Previously Presented) The system of claim 40 
wherein said shape information is represented by an outline of 
said object. 

43. (Previously Presented) The system of claim 40 
wherein said shape information is represented by a mathematical 
representation of a set of pixels associated with said object. 

44-48 . (Cancelled) 



49. (Previously Presented) The system of claim 28, 
further comprising 
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means for transmitting information related to said viewer 
request to a remote location over a backchannel communications 
channel . 

50. (Previously Presented) The system of claim 28, 
further comprising : 

means for accepting from a viewer information regarding a 
commercial transaction, and completing said transaction. 

51. (Previously Presented) The system of claim 50, 
wherein the information regarding a commercial transaction 
accepted from a viewer comprises at least one of a viewer's 
identifier, a viewers address, an identifier of a viewer's 
financial account, a viewer's password, a viewer's personal 
identification number, a quantity, a model, a size, a color, a 
descriptor of a good or service to be vended, and a price. 

52. (New) The system of claim 28, wherein the 
plurality of annotations having equal timing information are 
different from one another. 

53. (New) A hyperlinked reception system comprising: 

a receiver receiving video and annotation data, the 
annotation data including image overlay data, object data for an 
object appearing on a portion of the video, and timing data; 

a data store coupled to the receiver for storing at least a 
portion of the received annotation data; and 
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means for synchronizing, responsive to a user command, 
display of the image overlay data and object data with the 
portion of the video based on the timing data. 

54. (New) The system of claim 53, wherein the image 
overlay data visually identifies the object in the portion of 
the video . 

55. (New) The system of claim 53, wherein the image 
overlay data includes location of the object. 

56. (New) The system of claim 53, wherein the image 
overlay data includes shape information of the object. 

57. (New) The system of claim 53, wherein the 
annotation data includes second timing data, the system 
comprising: 

means for removing the annotation data from the data store 
in response to a determination based on the second timing data 
that the annotation data is no longer used in the video. 

58. (New) The system of claim 53, wherein the 
annotation data is received in-band with a current video 
program. 

59. (New) The system of claim 58, wherein the 
annotation data is received over a broadcast transmission with a 
video stream. 
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60. (New) The system of claim 59, wherein the 
annotation data is received prior to receipt of the portion of 
the video stream displaying the object. 

61. (New) The system of claim 53, wherein the 
annotation data is received out-of-band separate from a current 
video program. 

62. (New) The system of claim 61, wherein the 
annotation data is received over a data communications network. 

63. (New) The system of claim 53, wherein the object 
data includes user selectable information, and the system 
further comprises: 

means for engaging in an electronic commerce transaction in 
response to a user selection of the user selectable information. 

64. (New) A hyperlinked broadcast system comprising: 
a video source; 

a video encoder in communication with said video source, 
said video encoder producing a transport stream; 

an annotation source providing annotation data including 
image overlay data for visually identifying an object appearing 
in a video frame; 

a data packet stream generator in communication with said 
annotation source and said video encoder, said data packet 
stream generator producing encoded data packets; and 
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a multiplexer system in communication with said video 
encoder and said data packet stream generator, said multiplexer 
generating a digital broadcast signal comprising an augmented 
transport stream from said transport stream and said encoded 
data packets, 

wherein said video encoder provides timing information to 
said data packet stream generator and said data packet stream 
generator synchronizes the annotation data from said annotation 
source with a video signal from said video source in response to 
said timing information. 

65. (New) The system of claim 64 wherein said timing 
information comprises one of timestamp information, timecode 
information, frame numbering information and global time of day. 

66. (New) The system of claim 64 wherein said 
annotation data further comprises at least one of textual data 
and graphics data. 

67. (New) The system of claim 64 wherein said image 
overlay data includes location information of an object in an 
annotated video frame. 

68. (New) The system of 67 wherein said location 
information includes a graphics location reference that 
represents a fixed relation to a set of pixels associated with 
said object. 
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69. (New) The system of claim 68 wherein said graphics 
location reference includes an upper left most pixel in said 
associated pixel set. 

70. (New) The system of claim 68 wherein said graphics 
location reference includes a centroid pixel of said associated 
pixel set. 

71. (New) The system of claim 64 wherein said image 
overlay data comprises location and shape information of the 
object in the video frame to be annotated. 

72. (New) The system of claim 71 wherein said shape 
information is represented by a graphical overlay of said 
object . 

73. (New) The system of claim 71 wherein said shape 
information is represented by an outline of said object. 

74. (New) The system of claim 71 wherein said shape 
information is represented by a mathematical representation of a 
set pixels associated with said object. 
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The attached sheet of drawings includes changes to Fig. 2D. 
This sheet, which includes Figs. 2B-2D, replaces the original 
sheet including Figs. 2B-2D. 

Attachment: Replacement Sheet 
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